Problem Note 30664: Model Comparison node might produce incorrect choice when data is partitioned
In SAS
® Enterprise Miner™, the Model Comparison node Selection Statistic property value you choose might be ignored when the node selects a model. The node might select an incorrect model when you have a Data Partition node in your flow, or when you specify your own validation and test data sets.
There are no warnings or errors to indicate that the incorrect model was chosen.
In order to determine whether or not the problem occurred, examine the results and compare the "Model selection based on" Fit Statistic value to the Selection Statistic property value you chose. If they do not match, the problem occurred — the node did not select the correct model.
If an incorrect model was selected, you can work around the problem by manually adding a line from the correct model node to any succeeding nodes.
Additional information depends on whether or not a decision matrix is created.
If a decision matrix is created, the following Selection Statistic property values will cause the problem:
- Default
- Valid: Captured Response
- Valid: Gain
- Valid: Lift
- Valid: Percent Response
If a decision matrix is not created, the following Selection Statistic property values will cause the problem:
- Default
- Valid: Captured Response
- Valid: Gain
- Valid: Lift
- Valid: Average Profit/Loss
- Valid: Percent Response
Operating System and Release Information
SAS System | SAS Enterprise Miner | Microsoft Windows Server 2003 Datacenter 64-bit Edition | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Microsoft Windows Server 2003 Enterprise 64-bit Edition | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Microsoft Windows XP 64-bit Edition | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Microsoft Windows 2000 Advanced Server | 5.2 | | 9.1 TS1M3 SP4 | |
Microsoft Windows 2000 Datacenter Server | 5.2 | | 9.1 TS1M3 SP4 | |
Microsoft Windows 2000 Server | 5.2 | | 9.1 TS1M3 SP4 | |
Microsoft Windows 2000 Professional | 5.2 | | 9.1 TS1M3 SP4 | |
Microsoft Windows NT Workstation | 5.2 | | 9.1 TS1M3 SP4 | |
Microsoft Windows Server 2003 Datacenter Edition | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Microsoft Windows Server 2003 Enterprise Edition | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Microsoft Windows Server 2003 Standard Edition | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Microsoft Windows XP Professional | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Linux on Itanium | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Linux | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
HP-UX IPF | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
64-bit Enabled Solaris | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
64-bit Enabled HP-UX | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Solaris for x64 | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Tru64 UNIX | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
64-bit Enabled AIX | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
Microsoft® Windows® for 64-Bit Itanium-based Systems | 5.2 | 6.1 | 9.1 TS1M3 SP4 | 9.2 TS2M0 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2009-10-02 12:21:46 |
Date Created: | 2007-11-30 15:02:11 |